TRANSIENCE/RECURRENCE AND THE SPEED OF A 
ONE-DIMENSIONAL RANDOM WALK IN A "HAVE 
YOUR COOKIE AND EAT IT" ENVIRONMENT 



ROSS G. PINSKY 

Abstract. Consider a variant of the simple random walk on the inte- 
gers, with the following transition mechanism. At each site x, the proba- 
bility of jumping to the right is io{x) £ [i, 1), until the first time the pro- 
cess jumps to the left from site x, from which time onward the probabil- 
ity of jumping to the right is |. We investigate the transience/recurrence 
properties of this process in both deterministic and stationary, ergodic 
environments {u){x)}xez- In deterministic environments, we also study 
the speed of the process. 



1. Introduction and Statement of Results 

A simple random walk on the integers in a cookie environment 
{a;(x, i)}xez,ieN' is a stochastic process {^n}^o defined on the integers with 
the following transition mechanism: 

PiXn+l =Xn + l|^n) = 1 " P{Xn+l = ^„ " l|^n) = C^(X„, F n)), 

where Fn = (7{Xq, • • • , X„) is the filtration of the process up to time n and 
V{x;n) = Yl^=QXx{Xk)- A graphic description can be given as follows. 
Place an infinite sequence of cookies at each site x. The i-ih time the 
process reaches the site x, the process eats the i-th cookie at site x, thereby 
empowering it to jump to the right with probability uj{x,i) and to the left 
with probability 1 — uj{x,i). If u!{x,i) = ^, the corresponding cookie is a 
placebo; that is, its effect on the direction of the random walk is neutral. 
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Thus, when for each x G Z one has uj{x,i) = ^, for all sufficiently large i, 
one can consider the process as a simple, symmetric random walk with a 
finite number of symmetry-breaking cookies per site. 

Letting Px denote probabilities for the process conditioned on Xq = x, 
and letting Define the process to be transient or recurrent respectively ac- 
cording to whether Py{Xn = x i.o.) is equal to or 1 for all x and all y. 
Of course from this definition, it is not a priori clear that the process is 
either transient or recurrent. When there is exactly one cookie per site and 
a;(x,l) = p G (^)l)) for all x G Z, the random walk has been called an 
excited random walk. It is not hard to show that this random walk is recur- 
rent [3], [2]. Zerner showed [6] that when multiple cookies are allowed per 
site, then it is possible to have transience. For a stationary, ergodic cookie 
environment {u>{x,i)}xez,i€Af, where the cookie values are in [i, 1), he gave 
necessary and sufficient conditions for transience or recurrence. In partic- 
ular, in the deterministic case where there are k > 2 cookies per site and 
a;(x,i) = p, for i = 1, • • • ,k and all x £ Z, a phase transition with regard 
to transience/recurrence occurs at p = ^ + the process is recurrent if 
p G (^) I + ^] ^-iid transient if p > | + Zerner also showed in the above 
ergodic setting that if there is no excitement after the second visit — that 
is, with probability one, ui{0,i) = ^, for i > 3 — then the random walk is 
non-ballistic; that is, it has speed: lim„^oo ^ = a.s.. He left as an open 
problem the question of whether it is possible to have positive speed when 
there are a bounded number of cookies per site. Recently, Basdevant and 
Singh [1] have given an explicit criterion for determining whether the speed 
is positive or zero in the case of a deterministic, spatially homogeneous en- 
vironment with a finite number of cookies. In particular, if there are k > 3 
cookies per site and Lo{x,i) = p, for i = I,-- - ,k and all x £ Z, then a 
phase transition with regard to ballisticity occurs at p = ^ + p one has 
lim„_,oo ^ = a.s. if p G (i, ^ i] and lim„^oo ^ > a.s. ifp> ^ + 1- 
In particular, this shows that it is possible to have positive speed with three 
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cookies per site. Kosygina and Zerner [5] have considered cookie environ- 
ments that can take values in (0, 1), so that the cookie bias can be to the 
right at certain sites and to the left at other sites. 

In this paper we consider one-sided cookie bias in what we dub a "have 
your cookie and eat it environment." There is one cookie at each site x and 
its value is uj{x) G [^,1). If the random walk moves to the right from site x, 
then the cookie at site x remains in place unconsumed, so that the next time 
the random walk reaches site x, the cookie environment is still in effect. The 
cookie at site x only gets consumed when the random walk moves leftward 
from X. After this occurs, the transition mechanism at site x becomes that 
of the simple, symmetric random walk. We study the transience/recurrence 
and ballisticity of such processes. We have several motivations for studying 
this process. One of the motivations for studying the cookie random walks 
described above is to understand processes with self-interactions. The ran- 
dom walk in the "have your cookie and eat it" environment adds an extra 
level of self- interaction — in previous works, the number of times cookies are 
employed at a given site is an external parameter, whereas here it depends 
on the behavior of the process. Another novelty is that we are able to cal- 
culate certain quantities explicitly, quantities that have not been calculated 
explicitly in previous models. For certain sub-ranges of the appropriate 
parameter, we calculate explicitly the speed in the ballistic case and the 
probability of ever reaching from 1 in the transient case. Finally, although 
we use some of the ideas and methods of and [1] at the beginning of our 
proofs, we introduce some new techniques, which may well be useful in other 
cookie problems also. 

When considering a deterministic environment to, we will denote probabil- 
ities and expectations for the process starting at x by Px and respectively, 
suppressing the dependence on the environment, except in Proposition [1] be- 
low, where we need to compare probabilities for two different environments. 
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When considering a stationary, ergodic environment {u}{x)}x£Z, we will de- 
note the probability measure on the environment by and the correspond- 
ing expectation by £^ . Probabilities for the process in a fixed environment 
Lo starting from x will be denoted by (the quenched measure). 

Before stating the results, we present a lemma concerning transience and 
recurrence. Let 

(1.1) Tx = inf{n >0:Xn = x}. 

Lemma 1. Let {^n}^o ^ random walk in a "have your cookie and eat 
it" environment {uj{x)}xez , where u!{x) G 1), for all x E Z . 

1. Assume that the environment u is deterministic and periodic: for some 
N >1, uj{x + N) = uj{x), for all x e Z. 

i. If Pi{Tq = oo) = 0, then the process is recurrent. 

ii. //Pi (To = oo) > 0, then the process is transient and lim„_^.oo = oo 
a.s.. 

2. Assume that the environment u is stationary and ergodic. Then either 
Pi{Tq = oo) = for -almost every lo or Pi{Tq = oo) > for -almost 
every uj. 

i. If P'fiTo = oo) = for -almost every oo, then for -almost every 
CO the process is recurrent. 

ii. If Pf{TQ = oo) > for -almost every u, then for -almost every 
u the process is transient and lim„_»oo^n = oo a.s.. 

The following theorem concerns transience/recurrence in deterministic 
environments. 

Theorem 1. Let {Xn}^=Q be a random walk in a deterministic "have your 
cookie and eat it" environment {u!{x)}xez, where u!{x) G 1) for allx G Z. 
i. Let u{x) = p e (^, 1), for all x e Z. Then 

Pi(ro = oo) = o, ifp<\; 
^ 3^<Pi(ro = oo)<i|=|, ^/pG(i,i). 
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In particular the process is recurrent ifp<^ and transient if p > |. 
ii. Let u) he periodic with period N > 1. Then the process is recurrent 
if F T.x=i T^Siy < 2 and transient if ^ Y.x=i T^S^y > 2- 

Remark 1. We note the following heuristic connection between part (i) of 
the theorem and Zerner's result that was described above. Zerner proved 
that when there are k cookies per site, all with strength p G 1), then the 
process is recurrent \ip < ^ + ^ and transient \ip > \ + -^- For the process 
in a "have your cookie and eat it" environment, if it is recurrent so that it 
continually returns to every site, then for each site, the expected number of 
times it will jump from that site according to the probabilities p and 1 — p 
is X]m=i — p) = Therefore, on the average, the process in a 

"have your cookie and eat it" environment with parameter p behaves like a 
k cookies per site process with k = (which of course is usually not an 
integer). If one substitutes this value of k in the equation P = \ + and 
solves for p, one obtains P = \- 

Remark 2. In the case of a periodic environment, it follows from Jensen's 
inequality that if the average cookie strength Yl^=i ^{^) > fj then 

X^i^i i^^^lx) ^ 2, and thus the process is transient. Indeed, it is possible 
to have transience with the average cookie strength arbitrarily close to ^: 
let to{x) = i, for x = 1, • • • , iV - 1, and u:{N) > 

Remark 3. Part (i) of Theorem [1] gives two-sided bounds on Pi(Tq = oo). 
In Proposition [2] in section 4, we will prove that Pi{Tq = oo) > ; 
p > |, with equality for p > |. We believe that equality holds for all p > |. 

The next theorem treats transience/recurrence in stationary, ergodic en- 
vironments {uj{x)}x£Z ■ 

Theorem 2. Let {X„}^q be a random walk in a stationary, ergodic "have 
your cookie and eat it" environment {u!{x)}xez ■ Then for -almost every 
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environment uj , the process is P!^ - recurrent if £^ i^i^(o) — ^ and P"^ -transient 
y ^ 1-1^(0) > ^• 

We now turn to the speed of the random walk. 

Theorem 3. Let {X„}^q he a random walk in a deterministic "have your 

cookie and eat it" environment with uj{x) = p, for all x. 

If p < J, then the process is non-ballistic; one has hm„^oo ^ = a.s.. 

If p > |, then the process is ballistic; one has hm„_+oo ^ > a.s.. 

In fact, 

X 10 
(1.2) Mm — - > 4p — 3, with equality if — < p < 1- 

n^oo n 11 

Remark 1. We beheve that equahty holds in (jl.2p for all p G (|,1)- In 
particular, this would prove non-ballisticity in the borderline case p = \. 

Remark 2. We note the following heuristic connection between Theorem 
[3] and the result of Basdevant and Singh that was described above. That 
result states that if there are k cookies per site, all with strength p G 1), 
then the process has speed if p < ^ + ^ and positive speed if p > \ + \- 
As noted in the remark following Theorem [H on the average the process 
in a "have your cookie and eat it" environment behaves like a k cookie per 
site process with /c = If one substitutes this value of k in the equation 
P = \ + \ and solves for p, one obtains p = \. 

In section 2 we prove a monotonicity result with respect to environments 
and the use it to prove Lemma [H The proofs of Theorems [T] and [2] are given 
in section 3, and the proof of Theorem [3] is given in section 4. 

2. A MONOTONICITY RESULT AND THE PROOF OF LeMMA [T] 

A standard coupling [61 Lemma 1] shows that {X^j^Q under Py stochas- 
tically dominates the simple, symmetric random walk starting from y. How- 
ever, standard couplings don't work for comparing random walks in two 
different "have your cookie and eat it" environments (or multiple cookie 
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environments) — see [6]. Whereas standard couplings are "space-time" cou- 
plings, we will construct a "space only" coupling, which allows the time 
parameter of the two processes to differ. 

Proposition 1. Let uji and L02 be environments with 1^1(2:) < uj2{z), for all 
z £ Z. Denote probabilities for the random walk in the "have your cookie 
and eat it" environment uJi by i = 1,2. Then 

(2.1) P^^iT, <T^AN)< P'^^iT^ <T^AN), for x < y < z and N > 0. 

In particular then, P!^^{T^ < T^) < P'^^iT^ < T^) and P^''-{T^ = 00) < 
Py-^T, = cx)). 

Remark. The same result was proven in [6] for one-side multiple cookies, 
where one assumes that the two environments satisfy uJi{x,i) < L02{x,i), 
for all X £ Z and all i > 1. The proof does not use coupling. Our 
proof extends to that setting if one assumes that the environments satisfy 
^i{x,j) < u!2{x, i), for all X G Z and all j > i > 1. 

Proof. On a probability space {Q,V), define a sequence {C^fcjfcLi of 
random variables uniformly distributed on [0,1]. Let J^k = '^{Uj ■ j = 
1, • • • ,k). We now couple two processes, {X^} and {^^}, on {i^,V) so that 
{X^} has the distribution of the Py^ process, i = 1,2. The coupling will be 
for all times n, without reference to Tx or or in the statement of the 
proposition. We begin with Xq = Xq = y. For i = 1,2, we let XI = y + 1 
or XI = y — 1 respectively depending on whether Ui < u)i{y) or Ui > u>i{y). 
If Ui < iL>i{y) or Ui > u>2iy), then both processes moved together. In this 
case, use U2 to continue the coupling another step. Continue like this until 
the first time ni > 1 that the processes differ. Necessarily, X^^ = X"^^ — 2. 
Up until this point the coupling has used the random variables {f^fcj^^j^- 
Now leave the process {X^} alone and continue moving the process {^^}, 
starting with the random variable Uuq+i- By comparison with the simple, 
symmetric random walk, the {^^} process will eventually return to the 
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level X^jj of the temporarily frozen {X^} process. Denote this time by mo- 
So X^^^ = X^^. Now start moving both of the processes together again, 
starting with the first unused random variable; namely, Umo+i- Continue 
the coupling until the process differ again. Then as before, run only the 
{X^} process until it again reaches the newly, temporarily frozen level of 
the {X^} process, etc., etc.. 

Clearly, the {X* } process has the distribution of the P^' process, i = 1,2. 
Let r; denote the hitting time of r for {Xj,}. We claim that {T^ < T^AN} C 
{T^ < A N}, from which it follows that ViT^ < A N) < ViT^ < 

A N), thereby proving (j2.ip . We explain this, using the notation in the 
previous paragraph. Consider the processes {X^} restricted to J^no- From 
the construction, it is clear that {T^ < A X} n {T^ < uq} = {Tf < 
A N} n {Tf < no}. If this event does not occur, then consider the 
processes restricted to Tmo- Between time no and mo the {X^} process 
might hit x. Because of this, and because it is possible that mo > N, it 
follows that {T^ < Tl A N] r\ {T} < mo} C {T^ < A N} n {T^ < mo}. 
Continuing like this on each succeeding pair of intervals, the first one of 
which the processes move together in a coupled manner and the second 
one of which the {X^} process is frozen and the {X^} process moves alone 
until it returns to the level of the frozen {X^} process, we conclude that 
{T^<T^AN}C{T^<T^AN}. 

The last line of the proposition follows by letting N ^ oo and then letting 
z — > oo. 

□ 

Proof of Lemma[Tl (l-i). Since Pi{Tq = oo) = 0, the process starting at 1 
will eventually hit 0. It will then return to 1, by comparison with the simple, 
symmetric random walk. Upon returning to 1, the current environment, call 
it uj' , satisfies u' < to, since a jump to the left along the way at any site x 
changed the jump mechanism at that site from u>{x) to ^. By Proposition 
[H it then follows that the process will hit again. This process continues 
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indefinitely; thus, Pi{Xn = i.o.) = 1. For any x G Z, there exists a, 5x > 
such that regardless of what the current environment is, if the process is 
at it will go directly to x in |x| steps. Thus from Pi{Xn = i.o.) = 1 
it follows that Pi(X„ = x i.o.) = 1, for all x €z Z. Now let y > 1 and 
let X < y. There is a positive probability that the process starting at 1 
will make it first y — 1 steps to the right, ending up at y at time y — 1. 
The current environment will then still be to. Since = x i.o.) = 1, 

it then follows that Py[Xn = x i.o.) = 1. Now let y < and x < y. By 
comparison with the simple, symmetric random walk, the process starting 
at y will eventual hit 1. The current environment now, call it uj' , satisfies 
io' < UJ. Thus since Pi{Xn = x i.o,) = 1, it follows from Proposition [1] that 
PyiX = X i.o.) = 1. 

(1-ii). Let Pi(To = oo) > 0. We first show that Py{Tx = oo) > 0, for all 
X < y. To do this, we assume that for some xq < yo one has Pyo{Txa = 
oo) = 0, and then come to a contradiction. By the argument in (1-i), it 
follows that PyQ(Xn = Xq i.o) = 1, and then that Py^^(Xn = x i.o.) = 1, for 
all X £ Z. In particular, Py^^(Xn = i.o.) = 1. If yo = 1, we have arrived 
at a contradiction. Consider now the case yo < 1- Since there is a positive 
probability of going directly from yo to 1 in the first 1 — yo steps, in which 
case the current environment will still be u, and since = i.o.) = 1, 

it follows that Pi(X„ = i.o.) = 1, a contradiction. Now consider the case 
yo > 1. Since Pi(To = oo) > 0, there is a positive probability that starting 
from 1 the process will hit yo without having hit 0, and then after reaching 
yo, continue and never ever hit 0. But when this process reached yo, the 
current environment, call it to', satisfied uj' < uj. Since Pyg{Xn = i.o.) = 1, 
it follows from Proposition [1] that after hitting yo the process would in fact 
hit with probability 1, a contradiction. 

From the fact that Py{Tx = oo) > 0, for all x < y, and from the pe- 
riodicity of the environment, it follows that 7 = mixez Px{Tx-i = 00) = 
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inf2,.g|o,i,... ,Ar_i} PxiTx^i = oo) > 0. From this we can prove transience. In- 
deed, fix X and y. By comparison with the simple, symmetric random walk, 
with Py-probability one, the process will attain a new maximum infinitely 
often. The current environment at and to the right of any new maximum 
coincides with u. Thus, with probability at least 7 the process will never 
again go below that maximum. From this it follows that Py{Xn = x i.o) = 
and that lim„_>oo Xn = 00 a.s.. 

(2). It follows from the proof of part (1) that if Pi{Tq = 00) = 0, then 
P^^^{Tx = 00) = for all x > 1, and if Pf (Tq = 00) > 0, then P^+iiT^ = 
00) > for all X > 1. From this and the stationarity and ergodicity 
assumption, it follows that either Pi{To = 00) = for 'P'^-almost ev- 
ery u) or Pi{Tq = cc) > for P'^-almost every uj. For an uj such that 
Pi{Tq = 00) = 0, the proof of recurrence is the same as the corresponding 
proof in 1-i. For an uj such that Pf{TQ = 00) > 0, the proof of transience and 
the proof that lim„_»oo Xn = 00 a.s. are similar to the corresponding proofs 
in 1-ii. In 1-ii we used the fact that infx^z Px+iiTx = 00) > 0. However, 
it is easy to see that all we needed there is limsup^_,oQ Px+i(Tx = 00) > 0. 
By the stationarity and ergodicity, this condition holds for a.e. lj. 

□ 

3. Proofs of Theorems [T] and [2] 

Proof of Theorem [H For 2; G Z, define ax = inf{n > 1 : = x, X„ = 

X — 1}. Let Dq = and for n > 1, let 

(3.1) = #{m < n : Xm = x,ax > m}. 
Define 

(3.2) D„ = Y.i2u;ix) - 1)D^^. 

xez 

It follows easily from the definition of the random walk in a "have your 
cookie and eat in" environment that Xn — Dn is a martingale. Doob's 
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optional stopping theorem gives 

n-l 

(3.3) nPiiTn < To) = 1 + EiDt.at^ = 1 + ^{2iv{x) - 1)EiD^^^t„. 

x=l 

One has hm„_oo Pi{Tn < Tq) = Pi{To = oo). Let -fx = Px+iiTx = oo). 

Assume for now that the process is transient. For the meantime, we do 
not distinguish between parts (i) and (ii) of the theorem; that is, between 

= 1 and > 1. By the transience and Lemma [H > for ah x. 
Consider the random variable D^^^ under Pi, for x > 1. We now construct a 
random variable which dominates D^q- ^0 < T^, then = 0. If T^; < Tq, 
and at time the process jumps to x — 1, which occurs with probability 
1 — uj{x), or jumps to x + 1 and then never returns to x, which occurs with 
probability lo{x)jx, then one has D^^ = 1. Otherwise, D^^ > 1. In this 
latter case, the process will return to x from the right. Upon returning, the 
process jumps to x — 1 with probability 1 — uj{x), in which case D^^ = 2. 
Whenever the process jumps again to x + 1, it may not ever return to x, but 
for the domination, we ignore this possibility and assume that it returns to 
X with probability 1. Taking the above into consideration, it follows that 
under Pi, the random variable D':^^^ is stochastically dominated by IxZx, 
where Ix and Zx are independent random variables satisfying 



(3.4) 



Pilx = !) = !- P{Ix = 0) = Pi(T, < To), 
P{Zx = !) = !- uj{x) + uj{x)'yx; 

P{Zx = k) = {uj{x) - uj{x)-ix)i^''''^{x){l - oj{x)), k>2. 



Thus, EiP»f^ < EIxZx = Pi(r, < To)EZx. One has EZx = ^^^g^f • Thus, 

(3-5) ^^^^o<^r^^^A(T.<To). 
Substituting (|3.5p into p.Sp and using th.G monotonicity of Dn givGS 

(3.6) Pi(r„ <To)<- + -y2{2io{x) - < To). 

n n ^-^ 1 — ujIx) 

x=l 
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Consider now part (i) of the theorem. In this case uj{x) = p for all x, 
and thus 7 = 7^; is independent of x. Letting n — > 00 in (j3.6p and using the 
transience assumption, 7 > 0, one obtains 

(2p-l)(l-p7) ^ 
1 — p 

or equivalently, 

1 3p- 2 



(3.7) 7 = P,(ro = oo)< 



p2p — 1 

Since (13. 7p was derived under the assumption that 7 > 0, it follows that 
p > I is a necessary condition for transience. Note also that (13. 7p gives the 
upper bound on Pi(Tq = 00) in part (i) of the theorem. 

Now consider part (ii) of the theorem. In this case u;(x) and thus also jx 
are periodic with period > 1. By the transience assumption and Lemma 
El 7x > 0, for all x. Thus, letting n ^ cxd in ()3.6p . we obtain 

^ 1 - w(x)7a; 



(3.8) ^DM^)-1)^ 



> 1. 



x=l 



Since ()3.8p was derived under the assumption that 7^. > 0, for all x, it follows 
from (j3.8p that Y2^=i "^i-^/Z) > 1 is a necessary condition for transience. 



This is equivalent to ^ Ylx=i i-if^) > 2. 



The analysis above has given necessary conditions for transience in parts 
(i) and (ii), and has also given the upper bound on Pi{To = 00) in part 
(i) . We now turn to necessary conditions for recurrence in parts (i) and (ii) , 
and to the lower bound on Pi(Tq = 00) in part (i). For the time being, 
we make no assumption of transience or recurrence. Under Pi, consider 
the random variable D'j^^^^j,^ appearing on the right hand side of (|3.3p . If 
To < Tx, then D^^^j,^ = 0. Let ex^n denote the probability that after the 
first time the process jumps rightward from 2; to 2; + 1, it does not return to 
X before reaching n. Similarly, for each A; > 1, let ei^n denote the probability, 
conditioned on the process returning to x from x + 1 at least k — 1 times 
before hitting n, that after the A;-th time the process jumps rightward from 
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X to X + 1, it does not return to x before reaching n. Each time the process 
jumps from x to x + 1, the current environment, call it to" , will satisfy 
uj" < uj' , where uj' was the environment that was in effect the previous time 
the process jumped from x to x + 1. Thus, by Proposition [H it follows 

(k) 

that €x,n < ex,n, for A; > 1. In light of these facts, it follows that the 
random variable D^^^j,^ stochastically dominates IxYx-, where Ix and are 
independent random variables, with Ix as in (|3.4p and with Yx satisfying 

(3.9) P{Yx = k) = {l- uj{x) + oj{x)ex,n){oj{x) - uj{x)ex,nf-^ . k>l. 

Thus, 



(3.10) 



i?ii^?„ATo > EIxYx - ^--^-^l-^-^A(T. < To) 



- -^ TT~, — Pi{Tn < To), X = I,-- - ,n- 1. 

1 -UJ[X) +UJ[x)ex^n 



From ()3.3p and ()3.10p it follows that for any n, 

1 2w(x) - 1 
3.11 - V , \ ' , < 1. 

n ^ 1 - L0{X) + uj{x)ex,n 

X=l \ ' > 

Consider now part (i) of the theorem. In this case uj{x) = p for all 
x, and it follows that ex,n depends only on n — x. It also follows that 
lim(„_^)^oo ex^n = 7 = ^1(^0 = c«). If the process is recurrent, then 7 = 0. 
Using these facts and letting n ^ 00 in (jS.lip , we conclude that < 1 is 
a necessary condition for recurrence. This is equivalent to p < |. We also 
conclude that in the transient case, ^^^^^^ < 1 or equivalently, 

3p-2 



(3.12) J = P^{To = 00) > 

p 

This gives the lower bound on Pi(Tq = 00) in part (i). 

Consider now part (ii) of the theorem and assume recurrence. Then 
lim„_^oo £x,n = 0. Since uj{x) is periodic with period > 1, the environment 
to the right of x is the same as the environment to the right of x + A^. Thus, 
^x,n = ^x+N,n+N, and therefore linin-x^oo ^x,n = 0. Using these facts and 
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letting n ^ oo in ()3.1ip . it follows that a necessary condition for recurrence 
is F E^=i T=S{^ ^ 1- This is equivalent to ^ E^=i T^§J) < 2- 

□ 



Proof of Theorem 2. By Lemma [TJ the process is either recurrent for 
7^'^-almost every uj or transient for P'^-almost every uj. Assume for now 
almost sure transience, and let uj be an environment for which the process 
is transient. For the fixed environment uj, ()3.6p holds; that is, 



(3.13) P^Tn <To)<- + - J2(M^) - l)^—^^^^^^f^PnT. < To), 

x=l 

where = -f^{uj) = P^+i(T^ = oo). Note that {2uj{x) - l)^^^^if^ can 
be expressed in the form F{9^uj), where 9^ is the shift operator defined by 
9^{w){z) = uj{x + z). For each uj, we have limz->oo Pi (Tz < To) = 71 (w). 
Thus, letting n ^ 00 in ()3.13p and using the stationarity and ergodicity, it 
follows that 

(3.14) £'(2.(0) - 1) '7'°';°'"> > 1. 

1 — UJ[U) 



from (f3T4]l that g^ ^^^ > 1 is a necessary condition for transience. This 
is equivalent to £^ i^i?o) ^ 2- 



By the transience assumption and LemmalU 70 > a.s. . Thus it follows 

')-! 
.(0) 

) 

MO) 

Now assume almost sure recurrence. For any fixed environment uj, (j3.1ip 
holds; that is, 

2ujix) - 1 



-E- 

n ^ 1 



_ ■ w(x) +u;(x)ej:,„(a;) 



< 1, 



where ex,n{^^) is the Pj;^-probability that after the first time the process 
jumps rightward from x to x + 1, it does not return to x before reaching n. 
Since ex,n{^) < £x,x+m{^), for x < n — M, we have 

2uj{x) - 1 

< 1. 



n ^-^ 1 



^^-^ - a;(x) +a;(x)ea;,a;+M(w) 
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By the stationarity and ergodicity, 

1 

(3.16) lim -y'ex,x+M(w) = <?'^eo,Af a.s., 

x=l 

and by the recurrence assumption, 



(3.17) hm £^eo,M = 0. 

From (j3.16p and (j3.17p it follows that for each 6 > there exist rg, Ms such 

that 

(3.18) 

P^(-#{x £ {!,■■■ ,r}: e^,^+M < 6} > 1 - 5) > 1 - 6, for r>rs,M> Mg. 
r 

By the stationarity and ergodicity again, 

(3.19) lim i E ^"<"'-' = a.s.. 



x=l 



From (j3.15p . (|3.18p and (j3.19p . we deduce that a necessary condition for 
recurrence is 

^^T^W - '^^'^ ''^ equivalent to < 2. □ 

4. Proof of Theorem [3] 

Since the random walk {X„}^q is recurrent if p G (i, |], we may assume 
that p > |. The proof begins like the proof of the corresponding result in 
[I]. Let 

(4.1) U':^ = #{0<k<T^:Xk = m,Xk+i = m-l} 

denote the number of times the process jumps from m to m — 1 before 
reaching n, and let 

(4.2) Kn = i^{0<k<T^:Xk< 0}. 
An easy combinatorial argument yields 

n 

(4.3) Tr, = K^-U^ + n + 2Y,Ul- 

Since p > |, by Theorem [T] the process is transient, and by Lemma [Done 
has lim„^oo Xn = oo a.s.. Thus, Kn and Uq are almost surely bounded, and 
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we conclude that almost surely T„ ~ n + 2^^^q as n — > cxd. We will 
show below that there is a time-homogeneous irreducible Markov process 
{Yq,Yi,- ■ ■} such that for each n, the distribution of {U^, ■ ■ ■ ,Uq} under 
Pq is the same as the distribution of {Yq,--- ,1^}. By the transience of 
{Xn}'^=Q, Uq converges to a limiting distribution as n ^ oo. Thus, the same 
is true of Yn, which means that this Markov process is positive recurrent. 
Denote its stationary distribution on by fi. By the ergodic theorem for 
irreducible Markov chains, we conclude that 



{Xn}^=Q is ballistic if and only if YlT=o^^^(^) < speed of the 

process is given by ^+2J:'l,k^.(k) ■ 

We now show that there is a time-homogeneous, irreducible Markov pro- 
cess {Yq,Yi,- ■ ■} such that for each n, the distribution of {U^,--- ,Uq} 
under Pq is the same as the distribution of {Yq, • • • , Yn}, and we calculate 
its transition probabilities. For this we need to define an IID sequence as 
follows. Let P denote probabilities for an IID sequence {Cn}^=i of geomet- 
ric random variables satisfying P{Ci = n^) = ^'"^^i m = 0, 1, • • • . Consider 
now the distribution under Pq of the random variable U^, conditioned on 
f^m+i ~ 3- First consider the case j = 0. The process starts at and 
eventually reaches m for the first time. From m, it jumps right to m + 1 
with probability p, and jumps left to m — 1 with probability 1 — p. If 
the process jumps right to m + 1, then it will never again find itself at 
m. On the other hand, if it jumps left to m — 1, then it will eventually 
return to m. When it returns to m, it jumps left or right with probabil- 
ity ^. If it jumps right, then it will never again return to m, but if it 
jumps left, then it will eventually return to m again, where it again jumps 



(4.4) 
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left or right with probabihty ^. This situation is repeated until the pro- 
cess finally jumps right to m + 1, from which it will never return to m. 
From the above description, it follows that Pq{UI^ = 0\U^^i = 0) = p and 
Po{U:i = A:|C/;^+i = 0) = (1 - p)P(Ci = k-l), for k > 1. 

Now consider j > 1. As above, the process starts at and eventually 
reaches m for the first time. From m, it jumps right to m+1 with probability 
p, and jumps left to m — 1 with probability 1 — p. If it jumps to the right, 
then since j > 1 it will eventually return to m. Upon returning to m it will 
again jump right with probability p and left with probability 1 — p. By the 
conditioning, it will jump back to m from m + 1 a total of j times. As long 
as the process keeps jumping to the right when it is at m, the probability of 
jumping to the right the next time it is at m will still be p. But as soon as it 
jumps left from m, then whenever it again reaches m it will jump right with 
probability i. From this description, it follows that Po(f^m = 0|f^m+i = j) — 
pi+^ and Po(C/;^ = m^^^^ = j) = (1 - p) Eto^^'^(ES"' Ci = k-l). 

We have thus shown that there exists such a time homogeneous Markov 
process {Iqi ^i) " " " }• Denote probabilities and expectations for this process 
starting from m G {0, !,•••} by Vm and E^n- We have also shown that the 
transition probabilities of this Markov process are given by 
(4.5) 

if A; = 0; 

S^-P) Tj^i=,P'nYyitl'' = - 1), if A; > 1. 

As noted above, since {X„}^q is transient, the process {l^nj^o positive 
recurrent. Furthermore, denoting its invariant measure by the process is 
ballistic if and only if Y1T=q kfj,{k) < oo. 

We now analyze YlT=o^t^i^)- = inf{n > 1 ■ Yn = m}. By 

Khasminskii's representation [H chapter 5, section 4] of invariant probability 
measures, one has 

(4.6) ^ik = '^^^^=1^^^^"^) . 

£iai 



Pjk = V(Yi = k\Yo = j) 
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From ()4.6p . it follows that X^^Lq k/J-^k) < oo if and only if 

CTl 

(4.7) ^ < oo. 

m=l 

The generator of {I'nj^o is -P — -Z^, where Pu{j) = Y2T=oPjk^(k). Thus, 
letting 

n-l 

(4.8) = u{Yo), M« = n(y„) - (Pn - u){Ym), n > 1, 

m=0 

it follows that {M^}^q is a martingale for all functions u which satisfy 

oo 

(4.9) ''^^pjk\u{k)\ < oo, for all j. 

A:=0 

Consider the function u{k) = [k— 1)^. The ensuing calculation shows that u 
satisfies (gj]). From ([O]) and the fact that ECi = 1 and ECf = 3, it follows 
that 

Puij) = pi+Mo) + ii-p) Y.p'^( E '^^)' = 

(4.10) '=° 

p^+i + (1 _ p) ((j + 1 - ^2 + 2(i + 1 - 0) • 

From (j4.10p and the fact that {1 — p) X]£o ^P^ ~ T^' follows that 

(4.11) {Pu - u){j) = (6 - 2^3^ )i + 0(1), as j ^ oo. 
From Doob's optional sampling theorem, 

(4.12) SiM:^;,^ = £iM^ = 0, n > 0, 

and from (14. lip and (14. 8p . one has 
(4.13) 

(TiAn— 1 

fiM^^^„ = £:i(y,,An-l)^-(6-2^^)£:i ^ y™+ 0(^1^1 An) asn ^ 00. 



^ m=0 
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By the positive recurrence of {y„}^oi which holds for all p > |, one has 
Siai A n — > Siai < oo as n — > oo. Thus (|4.12p and (j4.13p yield 

(JiAn— 1 

£i(Y^,An - If - (6 - 2-^)81 Ym = Cn, for all n, 

(4.14) ^-P ^0 

where Cn = 0(1), as n ^ oo. 

If p > |, one has 6 — < 0. Letting n ^ oo in (14.141) . we conclude that 
(j4.7p holds if p > |, and thus the process {X„}^q is ballistic. 

To calculate the speed of the process we will need to build on some cal- 
culations used in the proof of Proposition [2] below. Thus we defer the proof 
of (jl.2p until after the proof of Proposition [2l 

For the case p G (|, |), we will need the following proposition. 

Proposition 2. Let {X„}^^q be a random walk in a deterministic "have 
your cookie and eat it" environment with uj{x) = p, for all x. Then 

Pi(To = oo)>|^, forpe{\,\)- 
(4 15) 2p — 1 3 4 

^i(ro = oo) = fc^, forpe[\,l). 

Remark. We believe that equality holds in Proposition [2] for all p G (|, 1). 

We will also need the following corollary, whose proof will be pointed out 
during the proof of Proposition [51 

Corollary 1. Let p G (|,1)- Let a\ = inf{m > 1 : = 1}. Then 
I = lim„^oo Ei^axhn exists, and I > 1, with equality if and only if Pi{Tq = 

^1 2p-l- 

We now prove non-ballisticity in the case p G (§> f)- Then we will prove 
Proposition [2j We break the proof into two cases — Pi{Tq = oo) > and 
Pi (To = oo) 

~ "^^^ ^^^^ ^^'^ dispose of easily. (By the remark 

above, we expect that this case is actually vacuous.) By Corollary [H we have 
lim^^oo -£'1^(71 An > 1- Using this along with the fact that lim„^oo ^o-iAn = 
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Y(j-^ = 1 a.s., it follows that 

(4.16) lim ^i(y^,An-l)^ = oo. 

n— »oo 

Now letting n ^ oo in ()4.14p . and using ()4.16p and the fact that 6— > 0, 
it follows that (|4.7p does not hold. 

We now treat the case Pi{To = oo) = ^^Ej- We take a completely different 
tack from the above. In [6j, it was shown that for the random walks with 
cookies in that paper, one has 

lim — - = — , Pq — a.s., where u = > Po(^7+i — Tj > j). 

i=i 

The reader can check that the same proof works for the random walk in a 
"have your cookie and eat it" environment. Thus, to prove nonballisticity 
in the case p G (|) f); it suffices to show that u = oo 

For m < j, let = inf{A; > Tj : X^ = m}. From the definition of the 
"have your cookie and eat it" environment, on the event jy- < ^i+i}) 

after hitting j — at time the process will eventually find itself 

^t 3 — a/7]i with the environment up to a distance [\\f]\ on either side of 
it being a simple, symmetric random walk environment. From j — [^V^]; 
the process must exit the interval [j — [sfj]-,]] before time Tj+i. By the 
scaling properties of the simple, symmetric random walk, there is a positive 
probability, independent of j, that it will take at least j steps to exit this 
interval, starting from its mid-point j — [^a/?]. Thus, we conclude that for 
some c > 0, 

(4.17) Po(T,+i - T, > j) > cPoiuj-i^ yj < T,+i). 
Therefore to complete the proof it suffices to show that 

oo 

(4.18) E^o(^,„[^];,<T,+i) = oo. 
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From the beginning of the proof of Theorem [TJ recall that Gx = inf{n > 
1 : Xn-\ = X, Xn = X — 1}. Define 



(4.19) 



= <; 



p, if > T. 



J' 



p, if ax = oo, 
^, if ax < oo. 



We introduce the notation Pq^'' \-) = Po{-\{Px'yxJi)- We can write 



(4.20) [Vj]-i 

r-=l 



Clearly, 



(4.21) 



Py'^'H'^j~i;j<Tj+i) = l-p. 



r U) 1 

The conditional probability {^j-r-i;j < '^j+iWj-r-j < ^j+i) is the 

probability that a simple random walk starting from j — r will hit j — r — 1 

before it hits j + 1, where the probability of jumping to the right is equal 

1 (7) 
to 2 at the sites x > j — r and is equal to pj_^. at the site j — r. This 

probability can be calculated explicitly using a standard difference equation 

with boundary conditions. We leave it to the reader to check that one 

obtains 

(4.22) 



'j-r-l;j < Tj+lWj~r;j < Tj+i) - 1 



P 



j-r 



(r + l)(l-p(^,)+p}!^. 



For every e > 0, there exists an j;^ > such that log(l — x) > —(1 + e)x, for 
< X < Xe- Thus, from (|4.19p - (|4.22p . it follows that there exists an such 
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that 
(4.23) 

Using (|4.23p and Jensen's inequality, we obtain 

/ [v^-i U) \ 

(4-24) ' ^ir+i Ki - /^jd.) y " 

y r=rE+l Pj—r 

Note that Hmj_»oo = • The distribution of is independent 

K,. P„('«(°^) _ _ 1 _ P„('^(°°) - _ 

2^ 

/) 

r and converges weakly to the distribution of as r oo. We have 



of X and is given by Po(pi°^'' = p) = 1 — -Po(pi°°^ = ^) = 7^ where 7 = 
Pi (To = 00). Note that in fact the distribution of p'^^^. depends only on 



Eq = — h 1 — 7- In light of these facts, and increasing if 

necessary, we have 



[v^-l A3) ^ 



(4.25) r=r,+l l-p}-r 



(7:; hl-7 + e) log VJ- 

1-p 



From (|4.24p and (|4.25p . we obtain 



(4.26) M'^j-mv < Tj+i) > - ^''^ 



^2(i+^)('rT^+i-'r+^) 
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Since e can be chosen arbitrarily small, it follows from (I4.26|) that ()4.18p 
holds if ^ilj^ + 1 — 7) < 1, or equivalently, if 7 < But we have as- 

sumed that 7 = Thus, (f4T8]l holds if < which is equivalent 

to p < |. This completes the proof of non-ballisticity in the case p G (|, |)- 
We now prove Proposition [21 after which we will prove (|1.2p . which as 
already noted requires some of the calculations in the proof of the proposi- 
tion. 



Proof of Proposition [2l Since for each n, {^^",---f^f} under Pq is a 
Markov process with transition probabilities pjk as above in (j4.5p and with 
stationary distribution /x, it follows that /io = hnin-^oo PoiUi = 0). On the 
other hand Pi{Tq = 00) = lim„_+oo -Po(t^i^ = 0). Thus, Pi{Tq = 00) = fiQ. 
By the invariance of and (|4.5p . we have /xq = Yl'jLoPjOfJ'j = Yl'jLoP'^^ f^j- 
Thus, 

00 

(4.27) Pi(ro = oo) = J^p^+Vi- 

i=o 

To prove the proposition, we will evaluate the right hand side of (I4.27|) . 

Consider the martingale {M^}^q defined in (j4.8p . with u{k) = k — 1. 
Using the fact that E(^i = 1, one has from (|4.5p 

00 j 

Puu) = Y.pMk) = -f''^' + {i-p)Y,p'E{ ^ G) = 

fc=0 l=G i=l 

^^•2^) -p^^' + {i-p)Y.p\j + i-i) = 

1=0 

+ (j- + i)(i - -^(1 - (j + ly + 
1 — p 

After regrouping terms, one obtains 

(4.29) (Pu-u)(j) = (2 - 3p + p-'+^(2p- 1)) . 

1 — p 

By Doob's optional stopping theorem, {M^jJ^Q satisfies ()4.12p . where ai = 
inf{m > 1 : = 1}. Using this along with (j4.29p and the definition of 
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{M«}- 0, we obtain 
(4.30) 8iY^,r.n = l + £i (2 - 3p + p^"+i(2p - 1)) . 



(TiAn— 1 



m=0 



By Khasminskii's representation of invariant probability measures [H chap- 
ter 5, section 4], one has 



(4.31) "^=° 



lim f 1 V (2 - 3p + p^-+^(2p - 1)) 

n^oo ■^^ — ' 1 — p ' 
m=0 

oo ^ 

(fiai) ^ (2 - 3p + p'+i(2p - 1)) 



i=o ^ 

This shows that the right hand side of (j4.30p converges as n — > oo; thus, so 
does the left hand side. Since ui < oo a.s., and since ^0-1 An is bounded from 
below and Y^j^ = 1, it follows that the left hand side of (j4.30p converges to 
a limit that is greater than or equal to 1 as n ^ 00. Thus, the right hand 
side of (j4.3ip is nonnegative; equivalently, Y2'jLoP'^^f^j ^ i^rf • From this 
and (j4.27p . it follows that Pi{Tq = 00) > 2p-i - "^^^ above calculation also 
shows that Corollary [T] holds. For the proof of non-ballisticity given above 
in the case p G (§> f )> this is all we need. We now continue and show that 
Pi (To = 00) = |£5f , if p > |. This will be needed for the proof of (fr2]) . 

3p-2 



First consider the case p = |. If on the contrary, one had Pi(To = 00) > 



2^5i; then it would follow from Corollary [T] that lim„-^oo > 1, and 

as noted in the proof of Theorem [3] (see (j4.16p l. this would imply that 
lim„^oo Ei(Y(j^/^n — 1)^ = 00. Using this and letting n — > 00 in (|4.14p would 
lead to a contradiction since 6 — 2^^ = 0. 

Now consider the case p > j. Let u{k) = exp(— 7(/c — 1)), where 7 > 0. 
Since /x is the invariant probability measure, we have 



(4.32) Yl ^^(-^^J = E = E exp(-7(j - 

j=0 j=0 j=0 
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Using the fact that £^exp(— 7(^1) = (2 — exp(— 7))"-*^, we have from ()4.5|] 



(4.33) 



Pu{j) = ^Pjfcexp(-7(A; - 1)) = p^^^ exp(7)+ 

00 j j+l-l 

k=l 1=0 i=l 



1=0 
j 



i=l 



p'+iexp(7) + (l-p)E 



1 



P 



y+iexp(7) + ( 
p'~^^ exp(7) + 



1=0 
1 



2 - exp(-7) 



2 - exp(-7) 
1 — p 



y+'a-p) 



l-(p(2-exp(-7))y+^ 
1 -p(2 - exp(-7)) 



p(2 - exp(-7)) - 1 



{pi 



+1 



1 



'2 - exp(-7) 



Substituting for Pu from the right hand side of (j4.33p into the left hand 
side of (j4.32p . and then muhiplying both sides of the resulting equation by 
p{2 — exp(— 7)) — 1, we obtain 



00 00 ^ 

{2p - l)(exp(7) - 1) E^'^'^V, = {1-P) E( 2-expf-^l ^'^'^^ + 

(4-34) 

((2p - l)exp(7) -p)Eexp(-7i)/ij. 

j=0 
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Differentiating ()4.34p with respect to 7 gives 
(4.35) 

00 00 
{2p - 1) exp(7) ^y'+Vj = {P- (2p - 1) exp(7)) ^ exp(-7i)j>j 

00 ^ 

(l_p)exp(-7)(2-exp(-7))-'^(- ^3 + 

^ 2 — exp(— 7) 



00 

(2p - 1) exp(7) ^ exp(-7j)//j- 



j=0 

I -11 + III- IV. 



(1 - p) exp(-7)(2 - exp(-7))-2 5](- V^''' 

^ 2-exp(-7) 



Letting 7 — > 0, the left hand side of (|4.35|) converges to (2p — 1) Y^'jLqP^'^^ l^j 
and III— IV converges to 3p — 2. Since p > |, it follows from Theorem [3] that 
< Thus, I— II converges to as 7 ^ 0, and consequently one 
obtains Yl'^=oP'^^ 1^3 — if^- Fro™ this and (14.27P it follows that Pi (To = 
00) = ^^rf • This concludes the proof of Proposition [2l (If one could show 
that I— II is non-positive for small 7 > 0, then one could conclude from 
the above calculation that Pi{Tq = 00) < ^pl^ , which in conjunction with 
the reverse inequality proved above, would prove that Pi{To = 00) = ||5f • 
However our analysis of I— II proved inconclusive.) 

□ 

We now turn to the proof of (jl.2p . As was noted in the paragraph follow- 
ing (14. 4p . the speed of the process is given by , , „^lb — r — . Thus, to prove 
(jl.2p . we need to show that YlT=o^f^k ^ i^rf) with equality if p G [jj, 1). 
The calculations are in the spirit of several of the previous calculations, ex- 
cept that they are more tedious. We skip some of the intermediate steps. 
First we show that 



in 

(4.36) ^A:V<oo, ifpG (-,1). 

k=0 
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Let u{k) = {k- if. From (fi3|) we have 

(4.37) Pu{j) = -pi+^ + {l-p)Y,p'E{ ^^f■ 

1=0 i=l 

We have already noted that E(^i = 1 and E'Ci = 3. One can check that 
ECf = 13. Also, one has (1 - p)J2Zo^P^ = and (1 -p)E£o^V = 

+ 2(y3^)^. Using these facts, one calculates that 
(4.38) 

{Pu-u){j) = f (so - (34 - 49-^ + 2{--^f)+0{l), as j ^ 00. 

Similar to (j4.7p . one has from (|4.6p that X^fc^o ^^/^(^) < 00 if and only if 

(4.39) ^^1 E ^™ < 

m=l 

Applying the argument from ()4.8I) to (14.141) . but using the function u{k) = 
{k — 1)^ instead of the function u{k) = {k — 1)^, using (j4.38p instead of 
dm]), and noting that 30 - < if p > j^, one concludes that (09]) 
holds if p > i^. This proves (14.361) 

We now prove the equality in (jl.2p for p G [jj, 1). The case p = jj uses 
the same type of argument as that used to prove that Pi(ro = 00) = in 
the case p = \- One uses the function u{k,) = {k — 1)^ and the calculations in 
the previous paragraph rather than the function u{k) = {k — 1)^. We leave 
the details to the reader. For the case p > we differentiate ()4.35p in 7 
and set 7 = 0. Two of the terms that result in this tedious calculation are 
±(1 — p) Yl'h=o ^^^fc- By (j4.36p . these terms pose no problem. One obtains 

00 00 

(4.40) {2p - 1) ^p'+Vi = 2 - p + (-8p + 6) 

j=0 j=0 

In the proof of Proposition [2l it was shown that Yl'jLoP^^^f^j = i^rf • Thus 
we conclude from ifiliO]) that Y!fLo3f^j = 3^- 

We now turn to the case P £ (|, jy)- The argument from (I4.29[) until the 
end of that paragraph, applied to u{k) = {k — 1)^ instead of to u{k) = k — 1, 
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shows that 

oo 

(4.41) >0. 

j=0 

A very tedious calculation starting from the formula for Pu{j) on the second 
line of (j4.10p reveals that 

(4.42) (Pn-n)(j) = j(6-T^) + ^(-5p+-^-^ + 2+p^+i). 

Substituting (|4.42p into (j4.41|) and again using the fact that '}2!f=QP'^^ — 
one concludes after a bit of algebra that Yl%^ojl^3 ^ 3^^- '-' 
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